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The public interest, which must be 
recognized by public institutions, 

and the ne@d for institutional and 
scholarly autonomy came into conflict 
at many points, and nowhere is this, 
more critical than in the devélopment 
of a comprehensive system wide infor- 
mation system. Knowledge is power and 
prior vzinformation results in prior 
power. The demand for additional . 
information by,coordinating boards and 
their staffs can be expented to grow-- 
and grow--and grow. 


-=-Fred Harcleroad ; 
in Joseph D. Boyd et al. 
"Comprehensive Information 
Systems for Statewide Planning | 
.in Higher : Education" (Iowa 
City: /American. College TeSENG 
i Program, 1971), p. 35 


ge”. 7 Reports are used to judge the performance, of -col- 
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The Paper Burden: Suggestions for ‘a 
Improving the Efficiency of fo 
Institutional Reporting = : 
Introduction 


leges and universities. The public demand for .accounta- 


bility in the expenditure of public funds requires 


branches of government, their committees and agencies to 
request and study regular performance reports from public” 
institutions in order to assure the effectiveness of their 
operations. Because expenditures for higher education 
consume a large share of total state revenues, legislators, 
"governors and the staff members of their supporting agen- 
‘cies have joined to create a multitude of reporting respoh- 
sibilities for the officers of Seatanes and universities. 
Dependent for their, continued support on the beneficence 
of the public and its government agencies, ee rn ee 
tions of higher education have little choice but t§ issue 
the’ reports on their work that elected officials and 


bureaucrats demand. 


| In their classic study of the financial control of 


_ colleges and universities, Russell and Doi consistently 


argue that institutions' efficiency can best be calculated 


4 4 
by measuring the proportion that each spends for instruc- 


XN 


tion of students. Institutional support expenditures, by 4 


! 


4 


gir 3 LR 
contrast, are minimized in efficient colleges and univer- 
sities. While Russell and Doi may sveealenld es the cri- 
téria #ae Sudging institutional. efficiency, few would dis- ; 
pute their contention that the main purpose of higher edu- 
cation is to discover and transmit knowledge, not to re- 
port on how the institution functions. Although réports 
to society on‘ the achievenents of higher edheaeyon help 

* colleges: to maintain their sources of support, reporting 
and administration is not the main Hustides of the insti-. 
, tution. Therefore, the cost of institutional reporting 
should be contained as ‘much as possible while. still allow- 
ing colleges and universities to communicate effectively 
with the external agenciés which constitute an ineortant 
link in iteir ‘public support. =. 

“ A tow states-have brought all their public col- 


’ 


leges. and universities under the direct management control 
of a Single board of regents or ‘suberboard. i ‘The super— 
boats ‘replaced the individual lay boards of trustees 
which existed earlier. This paper — not examine the 
relationship between colleges and "superboards" in those 
states but instead explores the more gebedl Hatavtanshie 
. between institutions of higher education and state coor- 
dinating boards of*commissions of higher education Sie. 
states which have left the management control of institu- 
tions in the hands of individual lay boards. Phe coordi- 


nating boards and commissions (hereinafter called "state 


© if 


‘ agencies"), are usually devoted to issues of planning and 
coordination of higher education rather than the’ govern- 
ance of individual colleges and universities. 

Because planning and coordination requires a 
thorough understanding of the present conditions within 
the institutions which are being coordinated and planned, 
the first task of a commission or coordinating board of | 
higher education is to study the structure, mission and - 

«productivity of institutions within its baitiwitck. “At 


first, coordinating boards may lack data on the operations 
s 


‘ 
Ws 


of colleges and universities. Or,. they may possess "in- 
Surmseian* chat has been eompiied xem as aggregation of. 
%® \,mixed and incompatible data. Such information, of course, 
is really misinformation., In order to create a reliable 
flow of information from institutions to-state coordinat- 
. ing boafds and commissions, agency analysts ‘must request 
from institutions both periodic reports and océasienal, 
special self-studies. Only in this way can the people who 
are charged with the responsibility for planning or co- ' 
ordinating state institutions of higher education be cer- 
tain that their policies are grounded in thorough under- 
standing. 


, 
Unfortunately, state agency requests for informa- | 


tion from institutions creates a heavy workload for insti-| 


tutional administrators (Boyd, p. 35). While Roger Bassett 


(p. 4) of the National Center for H{gher Education, Management 


, 
* 
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Systems (NCHEMS) suggests that periodic reports “and insti- 


tutional self-studies which Sepsis by state agencies. 


may ae useful to college ‘officers in exercising ‘what 


hactouy (passim) calls the operational and management con- 
trol of their institutions, there is evidence to suggest 
that much of the data requested by state agencies will not 
be particularly useful to local managers (Mods, py. 282); 


Local se agers, after all, have different BELGE respon- 


sibilitie _than. n. state-level planners and coordinators. 
Because the mission of a staff largely determines the type. 
of — it needs, the epectal mission of the commis 
sion or coor peru board renders Laci ch of the iacenngnnens 
collected by its staff less useful for institutional man- 
agement. of colaes Enees are exceptions to this rule. 
Some information\is vital to both the institution :and the 
board. State agencies can usually draw aneti information 
from universities with a simple request; the usa Gwen’ 
bases can be tapped to fill the request. 

Because their state- hovel responsibilities fre-- 
quently require coordinating Savas to collection Ato 
mation that is often of limited ie a to institutions, 


i . 4 
state-level information systems cannot depend for support 


‘on institutional eee systems alone. Continual 


updating of state-level information collections is compli- 
cated by the fact thatthe state - information system is 


not entirely Compatible with local, institutional data 


¢ 


| 
| 
| 


institutional use of state systems difficult. When' faced 


systems. By the, same token, the special character of 
y 2 72 ° ae 


state-level information needs and information systems make / 
with state agency requests for data, institutional officers 
cannot rely upon an interface ‘between their local informa- 
¥ oo 
‘ -. % ; F of 
tion system and that of the agency. Instead,’ they must 


take time to learn state-level.data definitions which may 


v 


not be part of the local system; Institutional reporting : 


to state agencies is'a special task; it cannot be accom- 
plished by merely allowing agencies access to existing .— 
institutional, information systems. ait . a. i ‘ 


Besides béing requested to report to agencies of 
’ . oe a ein 


state government,\ legislative committees and the office 


of the governor, institutions are. also asked to report to 

~ baa | . ‘ ’ 
ah bt F ' 

accrediting and licensing agencies at regional and na- ~ 


aw a : / 
tional “levels, and to national centers for the study of 


higher education. If an, institution is totally indepen- 


dent of federal sources of support and its operations are 4 
* : 
not endgngered by lack of regional and national accredita- 


tion, a collegé can afford to refuse national-level re- 
quests for data. Most institutions, however, find ae 
tional reporting, like state reporting, a somewhat dis- 
tasteful necessity., : 

Given the fact that institutions must nénoet to 


both state and national levels, can the reporting tasks 


be combined? On“the surface there is every reason t®& 
J 


think that they could. National centers seek data. that’ 


are readily aggregated with information from other insti- 


tutions. In order to make aggregatian of data easier, 


national collectors of data such as the American Associa- 


tion of University Professors (which conducts an annual 


salary/compensation survey), the National Center for Edu- 
cational Statistics (of the U.S. Department of Education), 
and the National Center for Higher Education Management. 


pn? 
Systems have created standard definitions and procedures 


‘for data collection. NCHEMS, for example, has developed 


‘a "Statewide Measures Inventory," a "list of items of in- 


formation, along with concise definitions, relevant to 
statewide post-secondary education planning and manage- 
ment" (McLaughlin, p. 1). The taxonomy provides a stan- 
dardized list of academic ebogeaas which can be used as a 
framdwork for reporting a Savieend wereeinen. The taxo- 
nomy is now utilized annually in the National Center's 
Higher Education General Information sieway or HEGIS. 
Coupled with a statewide measures inventory like that of 
NCHEMS, the HEGIS survey allows agencies to collect and 
aggregate compatible information‘ on both the offerings 
and the statistical performance of colleges and univer- 


sities by program area. 


Jd Of course, states are free (and even encouraged) ~ 


to use national standardized taxonomies and inventories. 


-. Because institutions have been required by the former 
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U.S. Office of Education to provide data in the new, stan- 


dardized HEGIS format, they have an investment, in national 
data collection techniques. "The requirements of the... 


HEGIS reporting, and its associated heavy information load, . 


; : : fF. 5 p 
*thave required that institytions devote considerable time 


and effort and the assignment of ADP resources to prepar- 
ing and .submitting these data once this reporting capacity 
has been developed" (Purves, p. 153). <Institutions in= + 
vested hoping that "requests for data by Beate seanoiees 
could be filled "quite readily if the HEGIS reporting 
categories are appeopplakes” Unfortunately,: many state 
"requests for information address specific organizational 
issues neither encompassed nor defined by the HEGIS cate- 
gories" (Purves, p. 153). 

Data most useful to state agencies are often not 
found in either local nor national data bases because the 
policy issues which motivate state-level data collection 
are not those which lie behind national and iqeeieubional 
data collection efforts. National information systems 
reflect the national concerns which led to their estab- 
lishment. (e.g., concern over tie number of gvaduatas annu- 
ally from sneieas medical schools). By. the same token, 
state data.collections reflect the different policy issues . 


faced by individual states. For example, agricultural / 


-stat@® may need to know how many graduate students in th 


4 


state are pursuing studies which could contribute to the 
4 


, 


search for adequate a as Sata for the state's 


farmers. It is Highly ° unlikely that HEGIS, NCHEMS or oth¢r 
national information systems would raaneis such aa re. 
tion. If local indtitwetons were “be keep track of such “1S 
information, it would probably not be in any statewide, ba 
standardized fount which could be easily utilized by 

state-level data collectors. 

To summarize, state and national agencies which 


4 


maintain collections of educational statistics have mis- 
sionS which differ distinction from each other. and from the 
, Mission of the single college or university. Because in- 
formation systems are established to serve the mission of 
those who create them, it is natural to ekpect Sra state- 
level i a needs cannot be met Hanly by tapping 
existing institutional and national information systems. 
The mission or role-defined difference of opinion 
between college aétlicens and state agency staff on give 
question of what institutional data is worth collecting 
leads some administrators to conclude that state agency 
data requests can only be expeoted to disrupt institutions 
and drain their manources away from instructional and 
research activities. Speaking the Benkd menke of many in- 
stitutional officers, Allan’ Ostar (p. 6) noteS the ten- 
dency of state agencies to ignore the cont OF theix data 


requests to institutions. 


~~ f 
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‘Some problems for higher education stem ffrom the . : 
states' desires ‘to collect data almost fdr its... = .-+° «. 
own sake--far more data than anyone reaTly can ~ ; 
use in meaningful’ policy decisions. - For example,’ 
one relatively small: western stdte university ° 
‘last year estimated that it spent at least . ae, 
$166,000 on reports - to 25 different. state central © * eee 
agencies. — This Imoney “had to come out of appropri- 
a ations to-the university. It was not available - 
for faculty’ Salaries, ‘library books,. laboratories — 
or other. purposes., Multiply such sums by several 
thousand colleges and you get: some idea of the 
cost in money as well as.staff. timé involved simply., 
in repofting to state agencies. 


Rough estimates of ee ee : 
agencies stay have to suffice for there appear td be no ; 
careful studies of the exact cost of state data requests; 
Institutional officers seem to agree, “however; ‘that data tae 
requests by shake agencies are increasing at a. dramatic | 
vate uléonen, Ds -8)5 Agreeing with the eizaeteal premise 
of Russell and Doi, Bowen and, Glenny emphasize the fact 
that much Se the institutional cost of vadauting ke state - 
agencies comes at the expense of “equally valid demands of. 
instruction and research" (Bowen, p: 69). | 

| " Weeheugh adequate arugtes on the exact cost of 
eotlege reporting to state agencies are yen: to be com- 
pleted, enough is known about the significance’ of cee costs 
to make timely some recommendations for the improvement 
of institytional procedures for the filling of state data 
requests. How can institutions go about developing pro- 

J 


cedures for the generation of data for state, agencies in 


4 


a prompt, accurate, yet politically astute manner? 


\ 


a 
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ake should emphasized that the responsibility 
for develonian fficient data-generating procedures is’ 
that of the college or university. Although agatuael 
‘agencies can and do make recommendations to institutions 
for the improvement of. their data generating cupaet ty 
ABassett), the institutions have me most to lose by re- 
fusing to ‘improve their procedures, As long as institu- 
tions continue to react to. exyennal requests for informa- 
tion, they will be unable to Sen beat the costs @hich are 
associated with conipliance. By systématically adopting © 
new, ef ficient.procedures for the generation of informa-.. 
, tion: for external aggncies,. institutions ,can begin to con- 
trol nen the number and the cost of requests £0r sacl 
‘5 "Because “the costs are paid £20in isabikubional POSRSRSs 
the responsibjlity for acting to reduce the costs belorigs 
to institutional officers rather than the staff or state 


or national agencies. 


More specifically, the responsibility for improv- 


‘ing institutional procedures for the generation of ‘data 


\ falls to the president, vice-president for business af- 


insect gh fs ‘ Sf 
airs, and director of institutional research of the 'col- 


r university. Because one of. their primary respon- 
sibilities is the preparation of reports for external” 
agencies, directors of, institutional research should be ~ 
Willing and able to study ways in which each step in the 


reporting process could be taken more efficiently. In 


; is 


1l i 


‘ 
institutions without a director of institutional research, . 
it falls to the vice-president for business affairs to 
bring to the president's attention the increasing costs 

of fastiteeional reporting to external agencies. The . 
president must then delegate supervision of responses to 

\ external data requests to one or more subordinate officers 
who understand (or are willing to learn) the steps which 
should be taken to improve institutional efficiency in 
responding. The following diecission is designed to help 
those responsible for institutional reporting understand 
the steps in the reporting process and some ways each step 


can be taken more efficiently. 


a 


I. Analyzing the Request for Data 


4 In order to comply appropriately with a data re- 
ie quest from an external agency, institutional officers 
| Biaee first understand; the arene of the request. Unless 
C --'a request's purpose eee a responding ivetieye 
tional dfficer might supply data which is unsuitable for 


y the study contemplated. If the agency staff recognize the 


unsuitability of the data, the institution will probably 

be requested to generate a second: costly run of informa- 

tion. If the data's inappropriateness is not recognized, 

the agency's study will lead to the publication of false 
. or misleading information--an embarrassment ultimately 


nts both for the agency and its institutional data-provider. 


‘ 
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Submission of inappropriate data can usually be 


avoided by asking the agency staff how the requested data 
will be used. The contemplated use of the data indicates 
what kind of data is actually required by the agency. ‘The 


refusalof .agencies to specify the ways in which requested 
data will be used should be a danger’signal to institu- . 


tions receiving data requests. In a publication of the 
National Center for Higher Education Management System. 


(pp. 14-16), Roger Bassett writes: "It is important that 


. 


a state agency be selective in the process of identifying 
. wor . ° 


data items (and) avoiding a collect-everything approach, 


‘ 52 A state agency must consider institutional resources 
and capabilities, both siereoeern and long-term, for pro- : 
viding data." The first task in improving institutional 
procedures for the generation of data tia, hens establish- 
ment of a policy that the institution will not fill pee : 
quests for data unless the external agency specifies how ' 


oy 


the data will be, used. To do anything less will encour- ‘ 
age the collection of inappropriate and misleading data 


and the over-taxing of institutional capacity for the 


generation of data. 
The documented existence of a great deal of unused’ 

data in state -agenty information systems (Dressel, p. 296; ’ 

Purves, p. 142) proves the need for a reduction in the 

ecuts of data requests., Just as a grocery bargain turns 


out to be no bargain at all if it is never consumed, the 


ee eg ERS 


the collection of unused data-is very expensive "no matter 
haw eb secrently it was obtained" (Bassett, p. 19). Refusal 
ot agencies to announde the use that will be aide of data 

. at the time of its collection is a signal that no particu- 
lar use has been defined and that the data might not be put 
to use. ‘Because institutions must bear the cost of gene- 
rating data, they ehoula be extremely wary of seliestine: 
tabulating and editing data chat may very well never be, 
used by those to whom it is seiivenud:, . 

’ After deciding what, is being requested and the 
likelihood that’ it will actually be put to agency use, 
prakinitionss officers should give some thought to the re- 
questing aaency?s right, to know what ‘it has requested. mi i # 
Would submission of data according to the request result 


es 
in the violation of laws which protect the privacy of in- 


dividuals whose records are held by the institution? The > 
Family Educational Rights sng Privacy Act of 1974 (the so- 

. called Buckley Amendment), requires the consent of students 
or their dapadts dn order: to release inaividual student 
records (Public Law 93-380, Title I , sec. 438, as amended, 
20 U.S.C. Sec. 1232(g) Supp. IX, 1974). The Privacy act 
of 1974 (Public Law 93-579, 5 U.S.C. See. 552(a)) prohibits 
he use Yof social security numbers as publicly available 
file identifiers. In addition, a number of takes: fade 


laws protecting the privacy of citizens and their records 


(Hollander, p. 53). Dressel (p.. 296) notes the concern of ° 


we 


we. 16° - oe 
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institutional research officers .for the protection of con- 


fidential records within their care. Computer-based re- 
cords are, in some ways, more difficult to protect than 
paper records for they are part of larger collection to 
which many people may have the right to partial access. 
The National Association of College and University Budget 
Officers' College and University Business Administration 
manvial (Section 2-5, p. 9) warns, however, that "consider- 
able quantities of confidential information relating to 
individuals are : stored in computers. Depending on Panett 
cular circumstances, the deliberate revelation of such 
data (through allowing access to computer files) “may ‘con “I 
stitute actional dncastcnst wt privacy." The wholesale 


. 


sharing of an aHstLeuesoyes information system with staff 


‘of a state agency would likely. be construed as an irres- 
_ponsible, deliberate violation of the rights of individuals 
whose records are stored in the information system. When 


‘faced with a request for data, college officers should 


avoid transmitting data in formats which could compromise 


the private records of individuals whose privacy is pro- 


. ’ ’ 


tected by law. 
Finally, each request for data should, following 


the NCHEMS “recommendation, be analyged@ for its probable 


‘cost to the institution: A state agency interested in the 


effectiveness of college programs might ask colleges to 


survey their alumni's satisfaction with the colleges' 


( | ae 


PSCROS S eter and its probable complexity, the following 


‘steps must also be taken. 


I. Analyzing the request for data; 


* . -~ 
II. Collecting the data: 4 


A. Informing relevant units ‘or department, 
! B. Checking existing data bases to avoid 


\ duplication, 
. C. Preparing report formats, 
, D. Actual collection activity, 


, —. Tabulating and editing of data, : 
F. Forwarding and filing of data; 


III. Monitoring the agency's analysis of the data; 


IV. Review of the agency's use of data in 
decision-making; 


V. Evaluating the data reporting procedures. 
Cost snatoele of data requests should improve as institu- 
tions begin to engage in regular evaluation of their data 
réporting systems (see V. apeuEl, Lacking such cost 
sevated: college officers can review the steps required ‘ 
"to meatan individual data request in order to provide 
some rough estimate of the institution's capacity for re- 
aa promptly and effectively. If the\ institution 
aaniate commit sufficient funds to the task of complying \ 
with a request for asks, the request can be. returned im- 
mediately with explanation to thé agency, which issued it, 
If the total seauast Or some parts of it seen especially 
: complex and time-consuming, the institutions might request 
a division of the request and state Support for the more 
“eomelieated, demanding tasks. If the request seems man- 
ageable, the external agency can: be informed immediately é 
, ( 


’ t ' t 
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programs on an annual basis. The purpose for such a sur- 


‘ 


vey is not hard to understand. If carried to completion, 
it might yield valuable information on the college's ? 
formance. But what would the costs of the immense data ~ 
collection effort be and couid the college realistically 
be expected to finance it from current appropriations? 
How aiach money would remain for the support of the main 
work of the college: instruction of students? yo 

Like requests for information that will never be 
used, ReuMeSts for unreasonably complex collections of 
data cost institutions money which they could better spend 
on instruction, service, and research. Unfortunately, 
there is evidence that state agencies are not always aware 
of what constitutes an unreasonably complex request. 
Purves and Glenny Sanere (ps 179) finding no cases of care- 
ful documentation of software costs incurred by institu- 
tions in the course of ‘establishing data bases for the 
preparation of reports tq external agencies. Once again, “ 
responsibility falls to the officers of institutions to 
analyze carefully. each request *for data in order to deter- 
mine its probable cost. Pa 

Estimates of cost must, be based on a thorough un- 
derstanding of the ‘steps which must be taken by an insti- . 
tution in fulfilling a request for data by an external 
agency. Beginning with the tasks of siaayoies a request ° 


for data to determine its nature, its propriety, its 


a 
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of the institution's intention to comply and projected 


timetable for compliance. 


II. Collecting the Data 

| Collectfng institutional data is not a simple 
affair even after the request for data Kaa been clarified. 
The effective collection of data requires that affected 
departments or units be notified of the study, that the 
inventory: of existing data bases be reviewed, that approp- 
riate formats for reporting requested data be prepared if 
they do not already exist, that responsibility for actually 
collecting the data be delegated organizationally, that 
the data collected be properly tabulated and edited, that 
the’ edited data be properly and promptly reported to those 
who requested it and others who have the right and need 
‘for it, and that the data either be incorporated perma- 
nently into the institution's internal management informa- 
en system or be filed or recorded as an “occasional re- 
port" in a place readily accessible-to institutional man- 


| 
agers who could use it to improve their performance. 


\ 


A. Informing Relevant Units .. 
' Or Departments See 


> When external agencies request information on in-° 
! . stitutional units, the ‘units should be informed for sev- 
\ eral reasons. First, the data request may signal a recon- 
bs | 


sideration of state educational policies which affect the 


studied unit. For example, a proposed study of enrollment 


. . 
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declines in foreign languagé courses may indicate a review 
( 


’ A . ~~ 
\of an existing policy to support all fields of study re- 


- 


gardless of the difference in demand for courses in dif- 
ferent programs of study. Or, it may indicate the state's 


interest in initiating a new policy to encourage the study 


_ of foreign languages. In either case, institutional of- 


ficers .who believe they can'read the handwriting on the - 
wall in state agency data \requests should share their in- 
telligence with those whom the handwriting will eventually 
affect. If it is to be believed that the agencies' collec- 
tion and analysis of data constitute a signal to colleges 
and universities, the signal:should be shared within the 
institution upon its receipe, | 

Units being studied by an external agency can also 


be helpful in reviewing data on their operations prior to 


. its transmission to the agency. If the data fail to re- 


flect adequately a unit's operations, the unit manager can 


either work to improve the data or, if weaknesses are in- 
f a 
herent in the type of data request the agency has made, the 


' 5 ange 
unit manager can provide documentation of its shortcomings. 
. | 


{ 
Ly 


For, example, if the data requested show a’ decline -in the 
number of students in foreign languase classes, a chair- 
person of foreign languages might be able to poinf out. the 
reasons for such a decline. If, for example, enrollments 
have fallen because foreign language faculty have been 


"borrowed" by an English as a Second Language program for 


a1 


a 


a 


falls to institutions to inform agencies of where the in- 
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foreign students, state agency staff should be informed. 
To do anything less would be to contribute to the misin- 
forming of those who have actively sought to understand 


the performance of a college or university better. 


B. Checking Existing Data Bases 

Once the unit affected by a proposed data collec- 
tion is notified of the collection effort, institutional 
officers should search current, existing institutional, 4 
state and national data bases to make certain that the re- 
quested information is not already availabld in convenient 
form. Institutions report to a variety of state agencies 
(Dressel, Dp. 292: Oster; p:. 6) it is conceivable that the 
information requested by one agency may have been reported 
‘recently to another.. Agencies lack a, convenient method of 
checking to find recently reported data for in only two . 


states do statewide information systems for higher educa- 


“tion exist (Purves, p.-43). In the remaining states, it 


formation they seek.may be found. On some occasions, 

state agencies fail to use the access they have to the 
Higher Education General. Tn€ormation Survey (HEGIS) or 
other sation? cottedeee of information. At other times, 
rapid staff turnover ik the agency may create "short or- | 
ganizational memory" with the result that agencies request 
the same information more than once (Wilson, p. 102). 


Duplication of reporting can often be prevented by an 
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efficient, alert state agency staff. But if a state-level 


request for information is duplicated, it) is not the agency 
‘that will pay the cost of a second report. The cost will 
be paid by institutions; therefore they must assume final 
responsibility for checking to be certain that a request 
for data’does not cause thé duplication of a data genera- 
tion effort. 

In order to detect duplicative data requests, in- 
stitutional* officers must keep a reliable seseed of former 
requests and the reports which were generated in response. 
The catalogue should be organized under type of data head- 
ings rather than chronologically in order to make its use 
more convenient for those who receive external jeanaeke 
for data. ty 

Of course, there will be times when new requests, 

. cannot be filled with existing data. Then an executive 3 r 
officer of the institution must delegate organizational ‘ 
responsibility for the execution of an appropriate report. 

The delegation of responsibility for responding to ex- 
isavvat*peqnesta for information can create organizational 

problems within the university. Sometimes, it is not clear 

which officer should be accountable for generating the 

“report to a state agency.. This is particularly true when 

agencies' request information on the costs of academic 


programs. The chief business officer of the university is, 


of course, the final guthority on costs. But the chief ' 
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instructional officer is the final authority on instruc- 
tional programs. Who should take responsibility for re- 


sponding to. the request? Trouble can also arise when one 


officer needs the cooperation of persons in another offi- 
cer's line (or jurisdiction) in brder to respond to the 
request for information. Does the reporting officer have 
the authority to order the generation of data from within 
a unit that is not ordinarily within his or her bailiwick? 
These organizational issues should be resolved before they 


actually arise in the process of ‘filling a request for 


*’ 


data. 
C. Preparing Formats for the 
Collection of New Data ' 

The person responsible for the collection of new 
data has several choices as to how, the data will actually 
be collected. It could be collected in formats supplied 
by the agency which first requested it. Or it could be 
doliected in formats especially designed be Soliact not 
only the requested data but also other data which would 
be ‘useful to local managers. The information could be 
seihe een only once or it could be collected on a continu- 
ing basis. Individual data providers cod be identified 
3 with their response or they could be afforded anonymity. 
(If data providers are to remain anonymous, data collectors 
will have some difficulty in urging those who are slow to. 

Se ae 


respond to comply with the request for data.) The data 


a2. 


could be collected and innadiaceiy aggregated and pane ted 
to data providers. Or it could be submitted to eatonnius 
analysis pits, These are some of the options for those 
charged with the design of a proper format for the collec- 
tion of new data. 

dorienkad data can be processed by hand, mechanic- 
ally or electronically. Before the actual collection of 
‘data begins, data ceases Sears? would be wise to design a 
collection format ‘that is Paes ee to the type of tabu- 
lation which is anticipated. For example, if data are to 
be processed electronically ,they probably should be col-— 
lected fn dtink, tape or optically-scanned format. 

Although Bassett is correct in claiming that "re- 
liance on special one-time surveys can improve the relation< 
ship between a particular analytical requirement and the - ' 
. data required to support it," it is also true that such 
requests area"very costly to the respondents" (Bassett, 
noe 2) pw DS). if ‘there is a good chance that the data 
about to be collected will be needed on a periodic basis, 
institutions should give serious thought to adapting an 
existing periodic collection format to meet the new data 
needs. The effort required in the data collection can be 
significantly reduced by utilizing a pre-existing data 
geoitestton Seonees For example, the U.S. Census Bureau 


‘is able to obtain new information about the American popu- 


lation in a relatively unobtrusive way by including new 
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questions in what most respondents perceive to be an old, 
and therefore familiar, process. By reducing the effort 
required to respond, the data collectors can encourage 
compliance with the request for data. 

On he other hand, adaptation of a previously- 
avivting data collection format can create organizational 
problems for the institutional officer charged with respon- 
sibility for responding to the external request for infor- 
maton.” Often the existing date eal hection format is per- 
ceived ~ the "property" of some office within, the organi- 
zation whose staff nay resent any attempt to "tamper with" 
their "property." Fear f threatening their peers! barrie 
torial sensibilities may cause many an institutional officer 
to collect her/his own information instead of utilizing 
data Ssclieeticn procedures that — already in use. Of 
. course, institutional officers are also, influenced by a 
aoe which emphasizes the need -for a data collection 
“specifically designed for one particular study. In the 
end, the organizational roses" respect for territori-. 
alism in the college and the purity of agency "research 
design: results in additional costs to the institution and 
its members who must receive, read, study and respond to 
more requests than otherwise would be necessary. 

After deciding whether or not to desi na totally 
new format for the collection of new data and after de- 


_ciding whéther to collect the new data only once or ona 


om 


*' advantage of the most efficient tabulation systems avail- 


duce the costs of tabulating and editing the collected 
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. regular, periodic basis, the institutional officer in 


charge must decide whether/ data on respohdents is to. accom- 
pany their responses. If respondent identity is to be pre- 
served only until forms are returned, some person must be 

ddfagatea the responsibility of separating the identifying 


label from the data after the response has been recorded. 


_If information on the respondent is necessary, considera- 


¢ 2 : ’ . , 
tion should be given to obtaining some of it from existing 


‘ ' 
ents to p 


data me Is it necessary, for example, to ask respond- 


vide sla ge baiaea ca! information such as 


their oftics numbers, rank, courses taught within the last 


jase etc.? xIf the information is-compiled using alvendye ; 


existing data banks, the cost of data collection in staff 


_time required will again be’ reduced. 


Data collection. formats should be designed to take 


‘able within the institution. Electronic data processing 


offices may be able to assist the data collection in the 


design of a format for collection which could vastly re- 


data. (Word processing systems now often contain both 


computational and editing capabilities.) At the same time, 


however, respondents often feel dehumanized by an electro- 


» 


nically-based survey which refuses to allow for creative 


human responses. If possible, therefore, formats shoald 


allow respondents an opportunity to talk back to those who 


¢ 


“ 


are collecting the data. Anecdotal responses and comments 


may provide helpful suggestions for the improvement of 
limited response Gicviionnai ea and thereby improve the 
effectiveness of the data collection. In addition, soli- 
Gited comments may help data collectors understand better 
the results of their efforts. . Whatever the means of data 
collection, designers of the collection effort should seek 
the assistance of those in the institution who wis most 

S icine with the problems of research design. Unclear 


“collection formats yield unreliable results and often 


force a duplication of the collection process. 


Da The Actua}’Col tion of Data 
Once e data to be collected are defined and an 


appropriate, efficient collection format conceived, the 


actual collection of.:the data can begin. A first step in 


“the collection of data is the briefing of line officers 
whose individual units will be asked to réspond to the 


request flor data. Officers may already have Heen con- 


sulted about the contemplated data collection during the 


~we-e--e-ti me-theinstitution 's-records~were~ being~searched -to~de- 


termine whether. the data were already available or during 
L. ~ the time an appropriate format for the data collection was 
being destoned. Néventhenaus: the line officers must be 
notified before the actual start of data collection if 
‘' data collectors are to avoid trespassing on the officers' 


|. - organizational territory. 


hatha 


More than the fragile ego of the line officer is 


involved here. Good line officers want t6 protect their 


employees from the sort of administrative distractions that 
data collections represent. They are‘also wary of how the 
policy issues inherent in a data solianeton effort may be 
construed. For example, would a survey of the number of 
publications by faculty, panic a lower division. staff bur- 
dened with very heavy vneehate loads? Deane and vice 
presidents could help aie’ any such panic by explaining 
the reason for the survey and its importance to the total 


institution. With the: support of apntopeiats Hane officers, 


‘y data collectors can Yexpect to collect more oe data - 


ina more efficient and timely manner than they could col- 
lect otherwise. Employees want to please their supervising | 


p 
officers and if they believe that their supervisors sup- 


. port the. data collection effort, they will be more likely 


to cooperate with it. 

‘Once administrativé support‘ for the data cobiec- 
tion has been laid, the effort can begin. Forms can be 
distributed, collected and tabulated. re is inputbarie 


Vssripncennbte 


that the distribution of any data collection forms be 


a break in the academic term or at a very busy time in 


well-timed. They should not be distributed just before J 


the term. It is too easy to lose a form one hasn't the 


cid 


time to answer immediately. The amount of paper in mo- 


tion in academic offices at the end of a term makes that 
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a very untimely season for the distribution of question- 


naires and other data collection devices. Lost forms mean 
extended and complicated eeiieeeen efforts with extra ex— 
pense to universities and colleges which could better use 
the funds é5 euspeet instruction. 

: oe 
E. Tabulation ane | Editing af Data 


After it is collected, data should an tabulated 
iicie., and edited to suit its intended: audience(s) . = 2 
The tabulation of data is not as simple as it might sound. 

Issues of daenush design arise when respondents fail to 
answer certain questions or when conflicting information 


is discovered. How should "missing.data" or "scrambled 


data" situations be handled? The often-used practice of 


assigning tabulation of data tod clerks or work-students 


is ill-advised unless the clerks and students have exper- 
tise or clear guidelines in the interpretation of vague or 


ambiguous data patterns. At the very least, there should ~ 


® . : 
_be agreement on how the tabulators are to handle the fol- 


. 
c 


lowing problems: ' a: 
Iv"no response is given; , eli 


2. two or more conflicting responses e given 
by a single respondent; 


3. different data sources yield confl\cting, 
contradictory information; 


4. a response pattern indicates that the informa- 
‘ tion is from an unreliable source. 
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_ pondents, institutional trustees, the news media) may be 


- 


It ig at the tabulation stage of data collection 


when the task of protecting the confidentiality of respond- 


ents is most difficult. If para-professionals are involved 
in tabulation, they should be reminded of the importance 
of keeping the data confidential. Responses should not be 
tabulated in heavily-trafficked aiae See they should be 
kept in a locked and secure place when they are not being 
used. After the oat have been tabulated, response forms 


should be shredded or otherwise safe-guarded from public 


inspection. (If there is any chance that the tabulation 


will have to be redone, response forms shquld be preserved 
for a reasonable period of time.) * 


After responses: are tabulated, the results may be 


.edited’in order to inform one or more audiences of the out- 


come of the data collection. Serious consideration should 
be given to preparing a special report for each of several 
potential audiences. The external agency which originally 
requested the data may be given a complete and sophisti- 


if 


cated account of the outcome. Other groups (such as res- . 


given an aggregated and more readily-understandable account 
of the results. Although distribution of a single report 
on the data collection would save time for ihoaw aie are 
responsible for its dissemination, in the end the time 
would be wasted in every case where those receiving ,the 


full report decided to discard it because of its excessive 


a | ( 
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complexity. Taking the time to tailor reports to specific 
audiences is a way of making more effective use of the = 
energies already invested in the collection of institu- 


_tional data. 


F. Forwarding and Filing Reports 
| Betoue data reports are forwarded from ‘the institu- 
tion, they should be checked for accuracy-by the executive’ 
officers of the a ca ‘To repeat:/ no report on the 
i. institution should be forwarded to external agencies until 
' _ college officers have had a reasonable Opportunity to re- 
view it. The review of reports prior to their dissemina- 


tion can prevent the embarrassment of publishing partial, 


inaccurate or misleading information. Moreover, giving 

institutional officers an opportunity to review the report 

allows them another opportunity to anticipate policy changes 
. which may well result from the agencies' analysis of the 
report which is being forwarded. Finally, igstitutional 
officers may find fvtornabinis in the report that is useful - 
to them in their role as managers of the institution. If 
‘they agree on the continuing usefulness of sich"Eeports™ 
for institutional management, they can request that the 
data collection procedure be made a vaguiine part of the 
college's management information system. 

Of caurse, adequately documented reports ,sgould 

‘be forwarded on a timely basis ke ened who have requested 


them. If separately-edited reports are’ sent unsolicited 
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' ‘receive a copy. Respondents, too, should be appraised of i, 


they are more likely to cooperate when the process is re- 
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to other audiences, an explanation of howyt$e report origi- 
%, 


nated and how it might serve the audiencég# ould be in- 
cluded. Unsolicited reports are easy to eile and forget, 
especially in organizations with rapid staff turnover and 
short organizational memory. A cover letter explaining 
the potential usefulness of an unsolicited report might 
sufficiently impress those receiving it to circulate either 
the report or, at the very least, notice of its availa- 
bility to staff members within the agency. 

Within the limits imposed by the need for discre- 
tion and protection of confidences, reports should also be 
circulated within the institution. If the college or uni- 


versity has a college archive or professional collection, \ 


-editions of the report should be placed there. All 


officers of units directly affected by the report should 


its outcome. As participants in an important process, 
they have a right to share in its outcomes.” Moreover, 


when respondents are informed of the outcome of a process, 


peated. Data collection efforts gain credibility among 
respondents as those collesting the data report competently 
the results of the collection efforts, Respondents are 
less like¥Y to give their full cooperation to coljection 
efforts which are coordinated by amateurs, novices and 


those who claim to be engaged in “trial runs," “first 
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passes," or “pilot projects." 
Finally, a visible and accessible descriptive cata- 
logue of all reports and data submissions (organized by 


subject) should be maintained within the institution. Only 


wide notice of reporting activities will prevent the need 


to duplicate them. : ‘ 


III. Monitoring the External Agency's °. ; 
Bawa of the pats = . 


_ Colleges and universities cannot afford to send 
information to external agencies merely assuming that the 
agencies will make fair and effective ae of it. Faulty 
agency analysis is all too common. Branches of state gov- 
ernment: and the agencies which they have created frequently 


. - , ¥v 


succumb to the temptation of making policy recommendations 


on the basis of only a i el of what Purves 


. , and Glenny Yo. 148) call collections or ‘asnenblyline® | ‘ 
ated. 


data such as “degrees granted" or “student hours gener 


(See Berdahl (p. 119) fos additfonal examplesLof shallow - : 
nnaivite st The faulty sraivede by agencies can effectively = 
undermine effective institutional reporting of performance 
data. No matter how carefully institutions go about sais 

lecting, tabulatings editing and reporting data, their 

efforts are for neiivhe if a succeeding analysis stage 

fails to lead to giicloakown which truly reflect the data. 

Because colleges and universities invest a significant 


part of their resources in the generation of information 


“ee 
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for external agshotas, they have an ficeene WH eens 
that the agencies. adequately analyze thes reported informa- 
tion. They should, therefore, act to monitor agency analy- 
sis in order to assure its adequacy. 
The analysis of college-generated information is 
not a simple matter, however. The "common denominator" 
of money linking effort (cena taren): and production 
(profit), in the private sector (Anthony, p. 41) is lack- 
ing in colleges and universities. Money cannot be used 
© measure the performance of colleges and universities 
cause their products are not sold on the open market. 
Because agency analysts often come from backgrounds in 
business and industry, however, there is a tendency to 
use a balancing of expenditures and "production" in order 


to judge the performance of institutions. When such 


> “assemblyline" analysis is not linked to an understanding 


of institutionaP mission and quality, questionable conclu- 
sions are reached. Good programs, more experienced educa- 


tional analysts know, cost more money}because they require 


_more and better resources. This is no€’ to say, of course, 


that the more expensive a program the greater its quality. 
It is to say that programs cannot be judged on economy of 
operation alone. , 

Both quality of program and uniqueness of mission 
drive’up the costs of academic programs, If a state de- 


pends on a given university to produce a constant flow of 


é 
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licensed veterinarians, should that university be faulted 

for "inefficiency" because its small program in veterinary 

medicine produces student credit hours at a cost slightly 
higher than the cost of veterinary medical programs in 
larger, neighboring states with larger schools of veteri- 
nary medicine? 

Another example of recurring (nadequate agency 
analysis of institutional data is documented by Purves and 
Glenny (pp. 145, 148) who note the tendency of state agen- 
cies to ignore the distinction between fixed and variable 
costs faced by institutions with fluctuating enrollments. 
Although:it may be simpler for legislators to send, fox 
example, $300 more to a college for each extra full-time © 
student it enrolls (and deduct from its appropriations 
$300 for each student disenrolled), in fact, an extra stu- 

_dent enrolled causes only a “marginal” increase in costs 
to a university. Although the extra student may require 
an extra dormitory room, textbook, etc., he or she creates 

‘ no additional need for sidewalks, administration build- 
ings or classroom heat. They are necessary even without ; 
‘the extra students’ enrollment. The "savings" of a single 
disenrollment are similarly "marginal." Nevertheless, 

“state agencies continue to recommend appropriations based 
on enrollment data along.without recognizing that the costs 
of larger enrallments are only marginal, 


Professional researchers agree that state agency 


- 
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analysis of data should take into account the unique his- 


tory, mission and geographical location of oo college 

and university (Dressel, pp. 296-297; Bowen, p. 257) in 

any judgment of its performance. | Yet such considerations 

complicate the task of analysis and for that reason they 

wmay well be ignored by agency staff who must struggle with - 

limited resources against a series of iuninant deadlines. 
Who can hold staff analysts to account for their 

work? Agency directors *are poor candidates for they are 

likely to be more worried about the agency's capacity for 

delivering some sort of analysis on time than about the 

adequacy of the aBkalysis. Agency directors are account- 

able to executive or legislative branches of government 

and are employed by elected officials who hope that the 


- 


agencies can defuse volatile .political issues. The idea 
that political decision-making can be replaced by the ana- — 
lysis of bureaucrats is what Robert Boguslaw calls the 
ideal of "the New Utopians" (p. 191). In the New Utopia, 
political problems | are assigned to agency staff who make 
decision-oriented (eaceantaiian based on a "study" of 
"data," The politicians than follow the Cbuvesnceats™ | ad- ee 
vice and, if criticized for their decisions, take refuge 
behind the "Analysis" Haas the agency staff has per- 
formed. As it turns out, no one from staff analyst to 
, state governor has any reason to find fault with the 


agency's! analysis for the analysis is used ada political 


r 
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shield against those who take issue with political deci- 


sions. If the quality of kgency analysis is to be moni- 
tored and controlled, it will have to be monitored and con- 
trolled by representatives of the colleges and universi- 


ties which agency staff claim to have analyzed. 


IV. Review of the Agency's Use 


of Data in Decision-Making : 


If a review of the relationship between reports of 
data to agencies and the agencies’ Acoivion-making reveals 
that an agency routinely collects institutional data merely 
to buttress decisiofis which its staff members or directors 
or influential politicians have already made, institutional 
_ officers should reevaluate their procedures for respondingg . 


to its requests for data (p. 143). or example, if agen- 


cies persist in recommending that. funding be tied to raw "| 
enrollment figures, universities would probably be wise to — 
forego elaborate explanations of i Eee or quality 

of their programs. If budget requests are routinely cut 


by a standard percentage ‘regardless of demonstration of 


‘ 


need, institutions would be :ieialllcacaulenan to submit a 
| tdvaan Mudaek™ request & in order t to get the sort of appropri-_ 
ation which is actually. needed to support a viable acade- 
mie program. | In either case, the costs of data collection 
to the institution could be cut to a bare minimum due to 


the refusal of state agencies to utilize the data in any ;. 


- 


serious, analytical review. 


. 


On the other hand, if policy decisions seem ee 
ingly to result from careful agency analysis of institu- 
tionally-derived data, colleges and universities would do 
well to invest more of their resources in the careful col- 
lection, tabulation, editing and reporting of data to 
state agency staffs. Whether college officers decide to 
spend more or less of their limited resources on the gene- 
ration of data for state agencies depends on whether they 
are dealing with "new utopians" or the sort of persons 
Williams calls the "human" decision-makers for whom the 

"mastery of vecorded facts is only a preliminary in arriv- 
ing at academic policies." For the. latter, "nothing can 
* supplant the human attributes that must come into play: 
sympathetic intelligence, imagination, courage and inte- 
grity" (Williams, pp. 177-178). For the new utopian, on 
the other hand, human attributes are more trouble than they 
are worth. Rather than engaging in endless debate which 
serious analysis allows, the utopian would seeding to uti- 
1 lize data to support the prompt, efficient administrative 
Seleleeacn of Mecision-making (Purves, P- 143). 

When colleges are reper with data requests from a 
“new utopian" agency or legislative committee staff, they 
have little choice but ‘to respond as players in a politi- 
cal game designed by the staff or the governmental bodies 
which created the agency and which can use the staff ina 


"new utopian" style. Instead of issuing reports to inform 


’ 
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agency staff members of the true nature of institutional 


performance, college and, university officers sometimes have 
“little choice but to provide only the minimum of informa- 
tion from being used against them by those who used facts 
merely to support previous decisions. Such an attitude 
toward state-level data requests is already common among 
institutional officers in states where agencies are the 
pawns of political interest grouse rather than being con- 
duits for the flow of accurate and sulisbke dncormckon 


(Miller, p. 23). 


V. syatuatang Data Reporting Procedures 2 , 


Finally, once every three years colleges and uni- 
versity administrators should keep careful record of the 
number of external data requests which they pacedve and the 
ways in which each data request was processed. Who was 
. assigned the task of filling the request? With whom were 
the reports filed? To what extent did the generation GE: 
"reports improve the institutional information system's 


data bases? Only through such an accounting method will 


+ 


~-the real institutional costs~of—generating-~data~—(in- both... <meta 
time and dollars) ba calculable. If possible, training 

in responding.to external data requests should be based on 

the lessons learned from: sich caréful, periodic accounting. 

All who are assigned the responsibility for responding to 

external gata requests should have the advantage of train- 


ing based on the institution's prior experience. Ideally, 
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both the accounting and the training would be handled by 
the director of institutional’ research who would be fa- 
miliar both with technical methods for' improving institu- , 


tional reporting and with the internal and external politi- 


eal problems which such ‘reporting can.create. In the ab- 


_ affects agency-institution relationships can be reviewed é 444 


; ' ee ae 
“the ways in which institutional response to data requests. 


sence of an office of institutional’ research, the executive 


officer of a college might ‘consider the preparation of a 


manual to guide those who are charged with reporting respon- 


sibilities. The mdmual should cover the issues raised in . 


this’ paper ranying: from analysis of the data request to Py 


\ 
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_ might be evaluated. . kz . | ; ” 


Although the dierituMon ts general policy dovenis 
}data coilection efforts by state agencies May not be capable 
of. encapsulation in the manual (especially in states where 
new. utopians. control weats agericies) , the manual can specify 
the need ‘to consult ‘with ranking executive officers of the 
institution prior i agencies with the informa- 


tion they request. ‘T e political context which currently 


in the process of the consultation. 

No matter how institutions decide to go about im- 
proving their capacity for responding to external requests 
for information, the task will not be a simple one. Gen- 
erating information is more complicated than it might at 


first seem and the complexity is compounded by political 
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considerations which shape the meaning and significance 

of data requests. The nélidey of simply giving agencies 
what they ask for has been recommended by some. Berdhal, 
for example, claims that if rivet iubiots can suppress — 
their distaste at having to fill out another set of papers , 
me they will probably soon learn that board reactions 
will tend to be pro forma’and thus fibiy easy to live 

7 with" (p. 161). But such a view is naive for agencies 

frequently ask for data which they do not need and panne 
use, or worsé, which they’ intend to misuse. For axanele; 
Purves and Glenny (p.* 159) note that in the view of some, 
state-level requests for’ information are sometimes made 
"simply to place the isistitution on the defensive or em- 


barrass it because it cannot provide the data.". The sheer 


volume of steadily increasing data requests (Carlson, 


.p. 102) is itsélf reason for taking a more sophisticated 


stance in res onse to state-level agency data requests. 
The strategy of giving agencies all they ask for 
in hopes that they will eventually "choke" on the mass of 


data that is provided hasn't worked. "State agencies," 


according to one observer, "are like Hydras--if one chokes a 
on the mass. of data you shove in its craw, two others 
spring-up by its side" (Cohen, p. 4). If the Hydra is to 
* be combatted effectively, institutions must take ‘the ini- 
tiative in improving the rationality istd tiaveby. the effi- 
ciency) of their procedures for submission of information 


a9 


be 


talk iyy 


Y 


to external agencies; In the end, the PAP EHORS burdyn 
will only be relieved by those who are now compelled to 


bear it. 


\\ 
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